Skip to content

feat(evals): preserve rubric criterion operators#1309

Merged
christso merged 1 commit into
mainfrom
feature/av-r0s-1-rubric-operators
Jun 6, 2026
Merged

feat(evals): preserve rubric criterion operators#1309
christso merged 1 commit into
mainfrom
feature/av-r0s-1-rubric-operators

Conversation

@christso

@christso christso commented Jun 6, 2026

Copy link
Copy Markdown
Collaborator

Bead: av-r0s.1

Summary:

  • Add optional rubric criterion operator metadata for correctness/contradiction semantics.
  • Preserve operator meaning through parsing, schema validation, LLM grader prompt construction, docs, and skill schema references.
  • Add regression coverage for parser/schema/prompt/YAML loading.

Verification from worker handoff:

  • focused operator suite
  • bun run verify
  • bun run validate:examples
  • CLI fixture dry run with mock target

Integration review: branch is 0 behind / 1 ahead of current origin/main.

@christso christso merged commit 29ed2ab into main Jun 6, 2026
8 checks passed
@christso christso deleted the feature/av-r0s-1-rubric-operators branch June 6, 2026 22:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant